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IMAGE PROCESSING METHOD, IMAGE PROCESSING APPARATUS AND 
STORAGE MEDIUM DEPENDENT ON PRESENCE OR ABSENCE OF A 
PERSON AS THE IMAGE SUBJECT 

5 BACKGROUND OF THE INVENTION 
Field of the Invention 

The present invention relates to an image processing method which is 
used to process a color image, an image processing apparatus which adopts the 
image processing method, and a storage medium which stores a program to 

1 0 achieve the image processing method. 
Related Background Art 

Usually, image data photographed or taken by a digital camera is stored 
as JPEG (Joint Photographic Expert Group) image data. Fig. 2 shows the flow 
of editing and printing for the JPEG image data. 

15 In Fig. 2, in a step S201, the JPEG image data is read into a memory (the 

outline thereof will be described later). Then, in a step S202, a decode process 
is performed to the read JPEG image data to obtain eight-bit/three-component 
YCbCr data. In a step S203, a 3 x 3 matrix is applied to the YCbCr data to 
obtain eight-bit/three-component sRGB data. Continuously, in a step S204, eaefe 

2 0 e£ -the R, G and B values of the sRGB data fe-are each displayed and is-corrected. 
Finally, in a step S205, a print process is performed to the corrected sRGB data. 

With the development of image pickup devices of the digital camera and 
image processing technology, the YCbCr data in the step S202 sometimes has a 
color gamut wider than that of an sRGB color space. In this case, a method of 

2 5 mapping any data that does not lie uneon t atnabl e- within the region of the sRGB 
color space into a boundary of the sRGB color space is often adopted to cope with 
sueh - a - this problem. 
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On one hand, a method of using such a wide color gamut as it is in a print 
process is sometimes adopted. That is, a According to this method, in she-step 
S203, the eight-bit YCbCr data is not converted into she-eight-bit sRGB data but 
converted into another eight-bit color space (hereinafter, called "xRGB data") 
5 having a color gamut wider than that of the sRGB color space, whereby the wide 
color gamut of the YCbCr data can be used in the print process as it is. 
However, in such a case, since the color gamut of the xRGB data is wider than 
that of the sRGB data though both the xRGB data and the sRGB data have eight 
bits, there occurs a problem that the tonality in the case of printing the xRGB data 
1 0 deteriorates as compared with a case of printing the sRGB data occurs. 

Therefore, in the case of printing the xRGB data, when a photographic object (i.e., 
an object to be photographed) is a person, there may < t cur a problem that the 
tonality of skin (flesh color) of the person in question deteriorates may occur . 

On the other hand, in acase of printing the sRGB data, clearness in a 
1 5 scenery image and the like is lackinged, whf* • ■ curs a problem that 

the color intended by a user cannot be reproduced in the print process may occur. 

For these reasons, the user has to complicat e d!)' perform the print process 
lll.a.con]pj|cated. way.... by appropriately selecting the color space suitable for the 
processed image. 

20 

SUMMARY OF THE INVENTION 

The present invention has been made in consideration of the above 
problems, and an object thereof is to provide an image processing method in 
which an appropriate color space is adopted according to a photographic object, 
25 an image processing apparatus to which the image processing method is applied, 
and a storage medium which stores a program to achieve the image processing 
method. An image processing method according to <-■■-■■€ aspcc • -1 ■■.< , \ nnt ] 
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5 obtained in the determining step. The second color space, which corresponds to 
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person as the subject, of the image, the second color space conversion cond ition is 
10 selected. .The in t >>- c lot j t e conversion on. 

l:ipuf Pi. .!.!::. I: !l!f iilO i'! ( :i'J ■ ,'K>! -!>,.».. ,'i)\e! m<>: : »<»::(!:■ 

The above and other objects of the present invention will become apparent 
from the following detailed description in conjunction with the attached drawings. 

1 5 BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a block diagram showing the system structure of the present 
invention; 

Fig. 2 is #*e-a.flow chart for explaining a printing method of a JPEG 

image; 

2 0 Fig. 3 is a diagram showing the structure of a digital camera; 

Fig. 4 is a diagram showing the structure of a JPEG (Exif) file; 
Fig. 5 is the-aflow chart for explaining a process of performing a print 
process for each color space in accordance with additional information; 

Fig. 6 is tfee-aflow chart of a process of assigning image data for each 
2 5 color space; 

Fig. 7 is the-a .flow chart of a process of assigning the image data for each 
color space; 
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Fig. 8 is the-a_flow chart of a process of performing a print process for 
each color space in accordance with an image analysis result; 

Fig. 9 is *fee-a_flow chart of a process of assigning the image data for each 
color space; and 

5 Fig. 10 is the-a_flow chart of a process of assigning the image data for 

each color space,j 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 

Hereinafter, the preferred embodiments of the present invention will be 
1 0 explained in detail with reference to the attached drawings. Here, the 

embodiment of switching a color space to be used in a print process according to 
photographing mode information described in a header of a JPEG (Joint 
Photographic Expert Group) file (Exif/DCF file) will be explained. 
(First Embodiment) 

1 5 Fig. 1 is a block diagram schematically showing the structure of the first 

embodiment of the present invention. An input apparatus 101, which inputs 
instructions from a user and data, includes a pointing system such as a keyboard, a 
mouse and the like. A display apparatus 102 displays a GUI (Graphical User 
Interface), and a CRT, an LCD or the like is usually used for the display apparatus. 

2 0 A storage apparatus 103 stores image data and programs, and a hard disk is 

usually used for the storage apparatus. A CPU 104 performs an entire process of 
fee- each above-mentioned eaeh-apparatus. A ROM 105 and a RAM 106 provide 
necessary programs and data and a work area te-for the CPU 104. It is assumed 
that control programs necessary in processes indicated in the following flow 

2 5 charts are stored in the storage apparatus 103 or the ROM 105. In a case where 
the programs are stored in the storage apparatus 103, the programs are once read 
into the RAM 106 and then performed. 
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It should be noted that, although an actual system includes various 
structural components other than such components as above, the explanation of 
these components will be omitted because they are not the central features of the 
present invention. 

5 Fig. 3 is a diagram showing the schematic structure of a digital camera 

which records a photographed image after performing JPEG compression. A 
digital (still) camera 301 is equipped with a mode dial 303, whereby a mode in 
photographing can be changed by rotating the mode dial 303. Moreover, there 
are four kinds of photographing modes which consists of a person photographing 

1 0 mode 307 for photographing a person, a scene photographing mode 308 for 
photographing the scene, a night scene photographing mode 309 for 
photographing the night scene, and an automatic photographing mode 306 used 
for photographing the most part of the scene. These modes can be changed 
every time the mode dial 303 is rotated, and the currently selected mode is 

1 5 displayed as an icon of a selection mode 305 on an LCD panel 304. When 
depressing a shutter button 302, a JPEG image is photographed in the currently 
selected mode. 

Fig. 4 is a diagram schematically showing the structure of the JPEG 
image photographed by the digital camera 301 . The JPEG image photographed 
2 0 by the digital camera 301 is usually stored as a file format called an Exif. A data 
description space called APP1 (OxFFEl) Marker exists in a header of an Exif file 
401, and information in photographing (model name, photographing time, 
photographing mode or the like) is described as Exif tag information 402 in APP1 
Marker. 

2 5 Fig. 6 is the-aflow chart showing a process of judging whether the JPEG 

image is to be emphasized in tonality or color gamut, referring to the 
photographing mode. In a step S601, a tonality emphasis bit flag of judging 
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whether or not the JPEG image is to be emphasized in tonality is formed ea-in the 
RAM 106, and that flag is initialized to "0" (OFF). In a step S602, the 
photographing mode is referred toby accessing to the JPEG image and a the value 
of the mode is read. In a step S603, when the read photographing mode 
5 corresponds to a person mode, the flow advances to a step S604, and when the 
read photographing mode corresponds to modes other than the person mode, the 
process ends. In fhe-step S604, the tonality emphasis bit flag is rewritten to "1" 
(ON) and then the process ends. Thus, when the photographing mode 
corresponds to the person mode, it is judged that the image is to be emphasized in 

1 0 tonality, and when the photographing mode corresponds to modes other than the 
person mode, it is judged that the image is to be emphasized in color gamut. 

Fig. 5 is the flow chart showing a process of actually printing the JPEG 
image. In a step S501, the JPEG image data is read on the RAM 106 to decode 
it into eight-bit YCbCr data. The decoded YCbCr data is expanded eB-in.the 

1 5 RAM 106. In a step S502, an Exif tag is analyzed from the JPEG image data 
read ea-in the RAM 106. In a step S503, it is judged whether or not the JPEG 
image data is to be emphasized in tonality from the analyzed Exif tag. This 
judgment process is the same as that explained ie-fche-above with reference to Fig. 
6. 

2 0 When the image is to be emphasized in tonality, the flow advances to a 

step S504, while when the image is to be emphasized in color gamut, the flow 
advances to a step S507. In tke-step S504, the eight-bit YCbCr data is converted 
into eight-bit sRGB data. For this conversion, although a 3 x 3 matrix is 
generally used, another method of using a conversion table or an ICC profile is 

2 5 also available. In a step S505, the image data expanded into the sRGB data is 
corrected (modified) by using an automatic correction module or application. 
This correction may be automatically performed or manually performed by using 
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the application software by a user. Here, it should be noted that any method is 
available in the correction. 

In a step S506, the eight-bit sRGB data is converted into eight-bit 
DeviceRGB data to perform a color matching for the print. For this conversion, 
5 although a conversion table is generally used, another method of using the ICC 
profile or the like is available. In a step S510, the DeviceRGB data is converted 
into CMYK data matching with the print. In a step S51 1, the print is performed 
on the basis of the data converted into the CMYK data. In #*e-step S507, since it 
is judged that the image is to be emphasized in color gamut, the eight-bit YCbCr 

1 0 data is converted into eight-bit xRGB data, this data being in a color space ef- 
having th- that. h.j„ : „a color gamut wider than that of an sRGB color space. For 
this conversion, although a 3 x 3 matrix is generally used, another method of 
using the conversion table, the ICC profile or the like is also available. In a step 
S508, the image data expanded into the xRGB data is corrected (modified) by 

1 5 using the automatic correction module or the application software. This 

correction may be automatically performed automatically, o r manually performed 
by using the application software by a user. It should be noted that any known 
method is-a <^h,k 'k 1 t*t th- - c orrection. However, in a. case of 

the-xRGB data, since there sometimes is a case where the image data cannot be 

2 0 displayed on the display apparatus 102, when the correction is manually 

performed by the user, the correction has to be performed under the condition that 
virtual color is displayed on the display apparatus 102. 

In a step S509, the eight-bit xRGB data is converted into tfe&-eight-bit 
DeviceRGB data to perform a color matching for the print. For this conversion, 

2 5 although the-a conversion table is generally used, another method of using the ICC 
profile or the like is also available. 

The process is sequentially continued to advance to the steps S510 and 
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S511 after the processes in the steps S506 and S509 wefe- have been performed. 

In this manner, it is automatically judged whether the image is to be 
emphasized in tonality or color gamut, by referring to the photographing mode of 
the Exif tag, thereby enabling one to perform the printing in a color space ef- 
5 matching with each of suitable for the particular image in question s. It should 
be noted that the data called "xRGB" indicates a color space having an arbitrary 
space wider than that of the sRGB data, and any color space such as 
AdobeRGB(TM) or the like may be used as xRGB if it has a space wider gamut 
than that of the sRGB data. 

10 In the present embodiment, the data is converted into she-eight-bit sRGB 

data only when the photographing mode corresponds to the person mode. 
However, it is available to convert the data into the sRGB data for another 
photographing mode emphasized in tonality. 

It is also possible to set the correspondence between the photographing 

1 5 mode and color space conversion in accordance with the instruction from the user. 
(Second Embodiment) 

Then, th y No I embodiment, where a JPEG image is printed 

upon judging whether the image is to be emphasized in tonality or color gamut 
from a photographing mode and other photographing information, will be 

2 0 explained. Since the system structure is the same as that of the first embodiment, 
the-explanation thereof will be omitted in the present embodiment. 

Fig. 7 is atfee-flow chart showing a process of determining if the image is 
to be emphasized in tonality or the color gamut by referring to the photographing 
mode and flash information being one of Exif tag information (photographing 

2 5 information). In a step S701 , a tonality emphasis bit flag , indicating ef - juelgi - ng - 
whether or not the image is to be emphasized in tonality is formed ee-injhe RAM 
106, and that flag is initialized to "0" (OFF). In a step S702, photographing 
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mode information is referred by accessing to the JPEG image and a value of the 
mode information is read. 

In a step S703, when the photographing mode corresponds to a person 
mode, the flow advances to a step S704, while when the photographing mode 
5 corresponds to modes other than the person mode, the process ends. In the step 
S704, the flash information is referred to. In a step S705, in a case of the flash- 
ON, it is judged that the image is to be emphasized in color gamut, and the 
process ends. This is because a. high possibility of a white blank (or white dot) 
for flesh color of a person being a photographic object is anticipated in a print 
1 0 process according to an sRGB color space in case of the flash-ON. In this case, 
the printing for a region of the white blank can be appropriately performed by the 
print according to an xRGB color space. On the other hand, in a case of the 
flash-OFF, the tonality emphasis bit flag is rewritten to " 1 " (ON) in a step S706, 
and then the process ends. In this manner, by using the photographing mode and 
15 the flash information, it is judged whether the image is to be emphasized in 
tonality or the-in color gamut. 

Since the process of performing the print is the same as that in the first 
embodiment, the-explanation thereof will be omitted in the present embodiment. 
In this manner, it is judged whether the image is to be emphasized in 
2 0 tonality or color gamut by utilizing the photographing mode and other 

photographing information, and it becomes possible to perform the print in g by 

s of a color space matching with -e aeh of -thc imagi 
according to the judgment result. 
(Third Embodiment) 

25 S - ubs - eq^ e ntlyvt - i ^ \ there iM pj n :■■>': embodiment in \Uiich- 

whefe a JPEG image is printed upon judging whether the image is to be 
emphasized in tonality or color gamut from additional information other than Exif 
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photographing information, will be explained. Since the system structure is the 
same as that of the first embodiment, the-explanation thereof will be omitted in the 
present embodiment. 

As the additional information to be added to the JPEG image, there are 
5 not only the Exif information described in the foregoing embodiments but also 
keywords of describing photographic object information, place information and/or 
event information, which are mainly utilized in the search. Among the above 
information, a person name can be described in the photographic object 
information. That is, from an inverse viewpoint, if the person name is added as 
10 a keyword, it is obvious that the person is recorded in the image. 

Fig. 10 is the flow chart showing a process of determining if the image is 
to be emphasized in tonality or color gamut by referring to the keyword in the 
additional information. In a step SI 001, a tonality emphasis bit flag of judging 
whether or not the image is to be emphasized in tonality is formed on the RAM 
1 5 106, and that flag is initialized to "0" (OFF). In a step S1002, the keyword in the 
additional information is referred to by accessing to the JPEG image and a value 
of the information is read. 

In a step S1003, in a. case efwhere_the person name is included in the 
read keyword, the flow advances to a step SI 004, and in other cases, the process 
2 0 ends. In ike-step S 1004, the tonality emphasis bit flag is rewritten to " 1 " (ON), 
and then the process ends. 

In this manner, when the person name is included in the keyword in the 
additional information, it is judged that the image is to be emphasized in tonality, 
and when the- no person name is set-included in the keyword in the additional 
2 5 information, it is judged that the image is to be emphasized in color gamut. 

Since the process of performing the printing is the same as that in the first 
embodiment, the-explanation thereof will be omitted in the present embodiment. 
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In this manner, it can be judged whether the image is to be emphasized in 
tonality or color gamut from the additional information other than the 
photographing information, and it becomes possible to perform the printing by 
means of a color space matching with e t e h- ui! lej the uj j images in 
5 question . At this time, it is also possible to judge whether the image is to be 
emphasized in tonality or color gamut by combining the photographing 
information with the other additional information. For example, if the 
photographing mode is set to an automatic mode, the image essentially has to be 
emphasized in color gamut. However, it is considered that in a case where the 
1 0 person name is included in the keyword in the additional information, the image is 
set to be emphasized in tonality. 
(Fourth Embodiment) 

The re will now be r i.'-cnU-d :m embodiment vvh^fe in which a JPEG 
image is printed upon judging whether the image is to be emphasized in tonality 
15 or color gamut by an analysis of the JPEG image without using additional 
information of the JPEG image, will be explained. Here, since the system 
structure is the. same as that of the first embodiment, the-explanation thereof will 
be omitted in the present embodiment. 

Fig. 9 is a the-flow chart showing a process of performing face 
2 0 recognition for an image and determining if the image is to be emphasized in 
tonality or color gamut according to the recognition result. 

In a step S901, a tonality emphasis bit flag e4 ]n i s whether 

or not the image is to be emphasized in tonality is formed en-in the RAM 106, and 
that flag is initialized to "0" (OFF). In a step S902, a face recognition process is 
2 5 performed te- on the image by accessing te-the JPEG image. 

When a face is recognized in a step S903, the flow advances to a step 
S904, and in other cases, the process ends. In the-step S904, the tonality 
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emphasis bit flag is rewritten to "1" (ON), and then the process ends. 

In this manner, if the face is recognized as a result of the face recognition 
process, it is judged that the image is to be emphasized in tonality, and if fee-no 
face is set-recognized, it is judged that the image is to be emphasized in color 
5 gamut. 

Fig. 8 is fche-a. flow chart showing a process of actually printing the JPEG 
image. In a step S801, the JPEG image data is read e«-m.the RAM 106., to 
decode it into eight-bit YCbCr data. The decoded YCbCr data is expanded ©a-in 
the RAM 106. In a step S802, a face region is detected from the JPEG image 
1 0 data read on the RAM 1 06. 

In a step S803, it is judged whether or not the image is to be emphasized 
in tonality, from a result of the face detection. A-The. process of judgment is the 
same as the process mentioned above with reference to Fig. 9. In a. case of the 
tonality emphasis, the flow advances to a step S804, and in a case of the color 
1 5 gamut emphasis, the flow advances to a step S807. Since a-the process to be 

performed thereafter is thesame as that shown in Fig. 5 (tha t is. steps S805, S806 

and. S808 SS i I aj.c the ,_ink as s > . v - >; ; ;u i d V ;« jS Si; ^•••jHvmdvj , 

fee-explanation thereof will be omitted in the present embodiment. 

In this manner, it can be judged whether the image is to be emphasized in 
2 0 tonality or color gamut from information other than the additional information of 
the image, and it becomes possible to perform the printing using.by-a color space 
ih j image i 

As means for analyzing the image, it is possible to use not only means for 
recognizing the face but also any means of capable of specifying, by detecting 
2 5 flesh color, that the photographic object is a person. 

The embodiments of the present invention are explained by an example 
of the JPEG image. However, it is needless to say that another image format is 
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available in an aspect of switching a color space to be used in printing according 
to the additional information. 

As described above, the present invention has been explained on the basis 
of the preferable embodiments. However, the present invention is not limited to 
5 these embodiments, but may be modified in various manners within the scope of 
the claims. 
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ABSTRACT OF THE DISCLOSURE 

JPEG image data is decoded into YCbCr data, an Exif tag is analyzed, 
and it is judged whether or not the image is to be emphasized in tonality,, 
according to the analyzed result. In a_case of tonality emphasis, the YCbCr data 
5 is converted into sRGB data, and the image data is corrected by an sRGB color 
space to perform conversion into DeviceRGB data. In a.case of color gamut 
emphasis, the YCbCr data is converted into xRGB data, and the image data is 
corrected by an xRGB color space to perform conversion into the DeviceRGB 
data. Then, the DeviceRGB data is converted into CMYK data to perform the 
1 0 printing. 



